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J^STRACT ' ' 



■A : 



A detailed cost analysis was performed as a part of, a study 
to compare "the cost effectiveness of voc^'tional programs having 
cooperative components (co-op) and vocational programs conducted entirely in 
the school (non-c«-op.) . The data were collected from" twelve .school 
•districts. The cost .analysis showed that there is not a clear-cut 
difference in coats between co-op and non-co-op programs when aggregate 
cost'^ measures are used. A strong logarithmic relationship was vfoyiid 
between atudent-afeacher ratio and cost 'per student, regardless of the, 
type, of vocational education method that is practiced. It is ^suggested 
that all educational* cost analyses consider .this relationship prior to 
attempting tb explain cos£ differences -.based ort other" variable^. 

The effectiveness comparison^' were based mostly on standard 
follow-up informatiornproyided by the schools on graduates the vocational 
programs. An addition, a btief Purvey ^of employers was conducted to ob- 
tain fl^me ^attitudes from^ employers r^tgarding graduates of co-op versus/ 
non-co-op programs. .The overall concltislon 'based on the fqllow-up measures 
la that there is no obvious 'difference between graduates of co-op ^vo- 
cational programs and graduates of.non-corop p^rograms. The overall con- 
elusions based o.ri the ^employer survey Are that employers ^ tend to favor 
graduates of ca-op programs^ and that- measuring effectiveness through a * . 
questioning of employers results ^in a much more clear-cut differential ^ 
between co-op ai^d non-*c6'-op ^programs than does ah analysis^df follow-up'' 
information normally collected, by school systems. 
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INTRODUCTION 

Public vocational education programs, as directed toward the 

» - ^ 
jgoal of producing, skilled workers, have employee^ a variety of method- 

plogias for this purpose. One of the most basic distinctions that can 

be made in these methodologies concerns "in-school" versus "out-of-school 

learning experiences. Thus, some vocational education programs have 

developed "cooperative" work experiences with business and industry to 

help in providing job skilly. Th6 essence of this idea' is to provide/ 

actual on-the-job working experiences as a part .of the edjucational 

programf Seemingly, "^fiocatiorfal education programs with a cooperati^d^ 



\ 

* , This paper was d,erive4 from: • ♦ * 

Molnar, D.E., Pesfit, E.N. , and W^ihalka, J.A. , Cos.t Effectiveness of 
Selected Cooperative Vocational Education Programs as Compared With 
Vocational Programs Without a Cooperative Component s Final Report,* 
Battelle-tfolumbus 'Laboratories; Columbus, •JDhio," June 29, 1973» 
This final repart contains a . review of the literature on cooperative 
vocational education ^nd relevant cost effectiveness analyses. 



component should meet the goal of producing skilled workers to a greater 
degree than vocational education programs that do not have ^ cooperative^ 
component, f or jtwo principal reasons, .FiTst, for many' occupations, it 
is difficult to conceive , that students can receive training 5olely^ 
through classroom and shop courses, that is* equivalent to the Jtraining 
r^ceivdd by students. Who havt on- l(he -job experiences as patt of .their 
program. Second, the real- life experience has been one criterion used * 
liy employers in hiring new employees. * / 

Nevertheless, there are difficulties with both of the positive 
aspects of cooperative vocational education mentioned above. Unless the 
school system provides teacher- coordinators who are t;ruly involved in ^ 
the worTc experiences., the job tasks given to the students might not be 
sufficieijvtly relevant to the educational objectives (e^^g., there may be 
no planned progression in assigned job tasks). 

Due to Tthe pressures of conducting business, employers mi^ht 
not have thfe time, patience, or instructional experience to help the 
cooperative students in a meaningful way. ' Tl\us, there is a question 
as to whether vocational programs with a cooperative component, are 
.atiy better than those without a cooperative component, i.e., whether 
all the available instructional time might be better spent in "in- 



rfchool" ^leftrnirxg experiences , 



The research question to be answered is whether or not there, 
is a difference in tne effectiveness andi the dost of vocational prpgratp/s 



with 4 cooperative component versus those without a cooperative component. 



(^t 



Thys, the basic analysis grocedty:e needed to answer the reseatch question 
ia a,cost-6f fectiveness comparison of the two types of vocational/education. 
' , This research study wars directed toward a preliminary determina-*- 

tiou of the cost-effectiveness .of selecft:ed cooperativervocals^onal edu- ^ 
cation programs and, the cost-ef f ect;iyeness of selected vocational programs . 
that do not have a cooperative, component. ' ^ , ' 



PURPOSE AND SCOl^E "OF THE STUDY 



The stated purposes of this exploratory study were: ^ , 

* ^ • 1) To identify and describe the various types of 

\ - ' * * - ' ' * 

coopetatfve and non-cooperative vocational - 

programs currently beittg conducted - 

2) To obtain cost comparisons bepji/e^ vocational . . ' ' 
programs utilizing the cooperative method and 
regular vocational programs 

^3) .Xo assess th^ effectiveness df various types 

of vocational^ programs * 

^ - « 

4)f /To obtain "data on the type of students in 

1 various vocational programs, together with . . ' . 

, * student performance in these programs.. " * ^ . 

Axi ancillary, purpose was to determine the present status of data availa- 
ble fdr making successive in-depth analyses. ^ • 



This paper concentrates on the rea^ultis' of .this' stvjdy relat;^ivp 

to the second and third objectives,, 'fhese deal .with ;the co&t and 

effectiveness comparisons and the meth6dology used^* . The emphas4s is 

* ' \ ' ' ' . " .* * * ' 

apt)r6pfiate for .the AEHA session, "Studies i,n, Edt^catiopal Plapning an^ 

Management". - - ' ' ^ • . . 

/*/• , ^ ** ^' '^ " 

^ „ The study focused on vocatiotial program^ at the jsecbndary 

" • . - ' ' ' " 

level. The following /iefinitions were used fe^iroughout the study.. 

- ' Voc^itional education is Refined to ijiclude only 

- high school programs — usually the junior ^nd/or ^. 

senior yearsv A vocational program is intensive. 

occupational preparation for -a specific occupatipnal 

^ ^ objective, or a cluster of occupations a<nd should 

* *^ ' ' » . 
not be confused ^th industrial arts programs which 

are more exploratory in nature/ f* ^ 

t « , "ft' 

" • Co-op Vocational education is defined to include 

the fo^owing characteristics: ♦ 

The co-op student is involved in a productive 

- employment situation directly related to his 

vocational objective. ^» . . ' 

♦ ' - There is a training plan, for each co-op student. * . 

- There is at least one period of in-school 

instruction directly related to the student*^ 

vocational objective. * • * 

•* There is availa^>le a school- employed coordinator 

r 

with adequate titpe^ for on-the-job supervision of 
- the co-op student. * ^ ^ . 



N9n-co«.op vocational education .programs are ^hose 
y ' that provide vocational training to.tally within the 

f 

school environment. 



SAMPLE POPULATION 



Twelve school districts, " 'four in each of three states, 

Minnesota, North >Car)>lina, and Ohio, served as data sources for the';- 

study. The characteri4]tics of these districts are shown in Tabl^ 1. 

.Altogether, data were collected from 20 high schools. Because of the* 

effort required to collect .and report data, and because of jthe"^ fact 

\^ " ' 

that not all vocational programs exist at each school, particular • 

schools did" not report on all of either the ico-pp or non-co-op programs 

* - * , • 

covered by this study., \ 

Data were collected and analyzed" for 14 "program are^ae which 



were^ 



Co-op Programs 

• Distribu*f9e Education * J. ' 

• ■ Diversified Cooperative 'Training 

• CooperaSive Office Education \. 

• Trade and Industry" * , 

N • ^ V\ • ' ' • 

• Cooperative Work Experience ^ 

- - • , - * V* ' ' 

Non-Co^op Programs ^ i-. 

\ _ ' ^. 

• Auto Mechapifccs ' ^ ' .A 

«i Auto Body ^ 

' ^ • 

Electronics/Electricity 



* The disttictj3 that reported on OWE. indicated that their programs met 
our definition' of^6*qp programs. , \ ' 

^ • 
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' • - . 'e Drafting . . . ' 

• ■'■ • * • • ■ \' ; - ' 

Machine Trades • • ' , 

• • Special 'Office Training (one school- district reported 

* ^ 

' . ^ * { on. this pi:6grafn) / ' ^ <^ • ' 

>^ . • Geaetal Ofifice 
^' • Stenographic : . ^ 

■• • Welding. - > ■ • . * > 

■ ^ ' ' - _ ' ^ '' ■ " 

.t • " . ' ■ ' COST ANALYSIS 

, ^ 'Iti' order, 'to Estimate the ye.ar;iy cost of a- prograiji, gat^ were* 
Collected for three main cost coiiponeivts" "Euilding construction ^9^5 1, 
direct instructional cost and laboratory equipmenf replacementr^c.ost J 

The building construction cost was amortized' oyer a«25*year peYiod, , - 

' ' ' 'ir. * ' * • ./''• 

with j£ost adjusted to 1971 dollars bashed on the y.ear of construction. 

No di'scountirig to' present .value was ii^pluded^o This" cl)j5t was prorated 

to a given vocational. program ba^ed on the. square f ootajge ^and ,tner 

ptoportlon or time' the space was lised.by the^pr^gisam. The, direct, 

instructional cost -included total teacher is^al.ati'es , and fringe teriefits 

^ } , . •* ' ^ o ... . •> ; 

> ' . # f • • « O ' J • 9 .* * * 

instructor's mileage expense for .transpdr tat ion, /cons 
• artd material costs, latforafory equipment re'ntal cost, a4i4 laooratory 
equij^ment contract' repair costs. The direct- ingtri^cftiohal cost was 
calculated as an average of the actual expenditure^ for the,1969r70 and 
1970-71' 3ch6ol,yea^s, > * . * ' \-. 1.- 



r 



8 • 



' The estimate of ^labjoratbry equipment replacement cost was ^ 

• * ' *. > ' * * 

based on three estimates given for -each prqgram-^-a lowest estimate,. 

an average estimate/ and a' highest estimate of Whart: it wcjp^^ co^t' 

in terras of 1971 dollars to replace all Equipment use3-by th^ program^ 7 

These fhr^e estimates j/ere converted t6 a weighted average as an 

.overall* estimate u^ing the^follbwing equation: '» . . 

C =^(C1 + 4Ca + Ch) /6/ . \ > ^ 

where CI? is the lowest, estimate, Ca is the average^ estimate, and, Ch 

is the highest estimate. The methpjd of averaging follows, the proce- 

; ^ / • ' ' - • - , 1* 

dures used in PERT- tygp *^nalyses *f or 'such estimation problems. The 

resulting average cost was amortized over 25 years for. programs usxng^ 

heavy equipment and lO^years for programs using of f i-ce ^equipment to 

yield an- average annual cost,, - \ • ' ' 

• * ' ' * ' . 

i . The aium of the annual estimates tor the three co,st comi)onents-- 

> \ ' . " ' ' - ' . 

buil^ng construction cost, d^irect instructional cost,,' and laboratory 

equ^-pment replacement cost;- -was assumed 'to represent the, total ^irinual 

cost of^ a particular vocational program at a particular school, 

Froin thi's total finnual cost 'measure, two other measbres were 

derived. The first of these is an, average annual cost per student.' The 

* • * / 

* ' •mi 

total numbers of 1970-71 senior and 1969-70 junior students were used 
for this purpose, Tfie sum of these* two totals represent an estimate 
of the yearly' total^ number* of 'studtents being trairted within a particular 
'program. The average annual cost per strudent w^s calculated as the 
, ratio of total yearly cost to the total number of students for a parti- 
cular program at a: partil?uiar school. ^ ^ ^ 



Reference9^ are listed in the REFERENCE section of th^s paper. 



* ^'^ The second mea.sure is the average annual cost for each hour 
' spent in vocational training per week. This measure was calculated • 

as the 'ratio' of the' annual total ^cost to the total number of student- 
hours per week. spent in instruction within a program, (This is 
analogous to the cost per credit hour that ia used in college and 

university Settings, and in some high schools,) For students in , ' 

< ^ * *' ' - • 

cb^op programs the average number of hours pe'r^yeek ip coordination 
" by the teacher- coordinator ijas also included because the 'school system 
must bear this co^t. The reasons for using this measure are discussed 
below, \ . , ■ 

• « Table 2 is a summary of the cost analysis 6y program, across 
all" schools, .In this table , and in the remainder of the discussion, the 
term/"Cost Per Student". is the average annual cost*per student and the 
tetm "Cost Per .Student- Hour" is the Annual cost for each* hour spent in 
vocational tifaining per iweek. ' 

/Several point^s become evident when Table '2 is considei^ed. 
Considering first the Cost Per Student;, the table shows an average o-f * , 
$355 for co-op programs and $545 fpr non-co-op pr^ograms. This is ^ 
differential of $190, However, if* individual programs are considered,* 
the variability of ,t;05ts for each ,of the two methods, ca-op' and 'non-co- 
is quite. large, ' Sdveral co-op programs show costs "higher than non-co- 

■ ' / . y ' ■ ■ • 

•op programs, and vice versa. This variability is even more pronounced 
on an individual^',s,chool basis. It beconjes questionable thep* whether 
or 'not the $190Mif ferentiWl is statistically significant. 
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'tui>thermore, detailed analysis of costs by program and - ' 

schools indicates that the principal contribution to the Cost Per 

' - • ' • # If 

Stu'flent is in the direct instructional cost element, which in turn 

might indicate that the total jiumber of student-hours in the program 

* 

might be ah important normalizing 'factor/ One reason for this is 
that the average hoprs>tker wepk spent in vocational laboratories 
and other .vocational stuJ[ieSi. differs markedly for the two types 
pf programs, viz,, • 

8,8 hours ^per week^for co-op programs 
> ^ 16 ,8 hours p^er week ^or non-co-op programs., * 

0 

Thus, we se% that there are almos-t twice as many, hours per week, spent 

# " • « .* 

in school in the non-co-bp vocational training as in the in-school*^ 
co-op vocational training, TJhis in/ turn might cau^e^J^^er student- 
teacher ratios in non-co-op programs, \and thus higher direct instriic- ^ 
tional cost per student. For this reason the Cost Per Student-Hour 
Vas. studied, since this measure apcounts for differentials in instruc- 
tiohal contact hours., if.. 



. r 



. * The measure of Cost Per Student-Hqur in Table 2. indicates 
the: following averages : . 

• • $40*. 35 for co-op programs 

. - ' ' * 

• ,$32*55 for non-co-op programs. 
This is a^ reversal of the relationship shown by the first measure, and 
indicates a. differential of about $8 per student-hour. Once again, 
detailed analysis of costs by program and school shows wide variability 
in this measure. and it becomes questionable whether or not this $8 - 



differential is startlstically significant. Because of the wide varia- 
bility^in the measures when considering progr^s at 'part.itular schools, 
the significance of the cost differences was questioned. A statistical 
test of significance for each of these two measures was conducted using" 

. ' ■ ^■ . '2 . * 

Welch's 'two- sample test with unequal variances. This test was. modified 
*to account for the fact , that , weigh ted means w^re b6ing tested <"number 
of students". fdr the measure--Codt -Per Student; and "number o£ student- 
hours" for the me^sure--Cost Per Student Hour). '.The modification was 
accdt]§>li^hed by using the Statistical Package for Soc;ial\ SCierit^ts^ 
(Welch's test procedure yields an approximate test, ixo.t an exact one«) 



The test of significance for* the mean Cost Per'Student . ($335 

for co-op programs versus $545 for non-co-op programs) yielded^ a t^st , 

statistic of -3.19 with -approximately 79 degrees of freedom. The test 

* . ' • . ^' * 

of significance for the mean Cost Per Student-Hour ($4,0.35 for co-op 

*- ' * - ' ^ 

program^ versus $32^55 for non-co-op programs) yielded a te^t statistic 
. - ^ . * ' - ' 

of 1,70 with approximately 66 degreed of freedom^ These ^results are « 
statistically significaht at the Ovl level of significance. Although 
it appears that the differences are signjLficant, the^.two measures yield 
different conclusions about the programs. Also it should be remembered 
that since the sample of schools and programs studied may n6t represent 
a random selecti<>n, the application^of statistical tests of significance 
which are based upon the assumption of -»mdom sampling ia questionable* 
We feel It would be unwise to accept the results of .the above tests as 



conclusive^. However, since this study was ^ explotatoxy study directed 
towaird fletermining the feasibility of conducting larger scale studies' 
of the same nature, the^ tests have been included as illustrative jnodels ^ 
for future' studies. ^ ' 

/ In^ an attempt to'¥u££hef understand the vari^Ulrt.ity withirt ^ ► 
the two cost measures being studied,, further analysis was performed 
using the student- teacher ratio as an independent variable. Scatter- 

grams of the two cost measures versus the student- teachfer ratio showed 

• ; 1- ; 

a definite logarithmic relationship. Regression ^analyses j;were perfcwrraed 
on the data .with very significant results. Table 3 shows the results 
for the mea'sure. Cost ^-er Student; Table A'^-^hows the results for the; 
measure. Cost Per Student- Hour. '- ,y 

Figure 1 shows the regression of the na^ral logarithm of 
student- teacher ratio versus the natural Ibgarithnj of Cost Per^*^uden£V 
Figure 2 is the regression for the Treasure Cost Per^tudent-Hour. 
Notice that in both cases the lines, for all pVogranid, co-pp-^ograms 
hnd non-cfo-op psrograms are very similar in slope and intercejft. 

These regression analyses show, as one wouJLd intuitively 
expect, a very s^trong logarithmic relationship bet^ween the tfost measures 
and tihe student- tfeacher Vatio. 



* tA convert the natural lo^rithmic scale simply use .the coordinates ^ 
'^from the figures and r^se the irrationll nt^er denoted by "e" 
(approximjateJLy 2.718280 to the power cprresponding to tiie value. 
Tor example, fironr-^gure 1, the point (3.0; 6.5) for tlie line for 
all pxpgrams corresponds to the point (20.1; 665) on the arithme.tic 
scale. This means that a student-^teacher ratio of 20.1 .corresponds \ 
to an' average annual Cpst Per Student of $665. \ . 



TABLE 3, 


REGRESSION ANALYSU^.ON COST PER STUCENT 




Regression 


Correlation 




Significanc'fe 


Data Base 


Equation- 


(ft) 




Level 


All Programs ^ 


Y=9.43-0.98X 


-0.92 


' 0.85 " 


0.00001 


\' - 

Co-op Programs 


Y=9.«5-l.i0X^ 


-0,96 


0.92 . 


o.ooooi • 


Non-Co-op Programs 


Y=9.07-0,87X' 


-0.88 . 


0.77 


0.00001 



* Y ~ Natural logarithm y>t Cost jPer Student' 
X = Natural Ipgarithm-bf Student-Teacher Ratio 



% f m 

> * 



TABLE 4. - REGRESSION ANALYSIS ON COgT SPER STUDENT-BOUR 



Data Base 


Regression 
Equation^' 


Correlation 


■ r2 


, Significance 
Level .' 


All* Programs 


-7=5. 05-0. 42X 


, ' • -0.^5 


■0,20 


ff.obooi 


Co*-op' Programs • 


fl(if5-;«,45-0,47X 


, '0.45 


0.20 


■ 0.00223 


Non-'Co-pp 'Programs . 


Y=5.41-0.59X 


' -0.67', 


. 0.48 


O.pOOOl 



* Y = N'atural logarithm of' Cost Per Student-Hour ^ 
X = Natural logarithm of Student- Teacher Ratio 
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FIGURE 1, PLOT OF REGRESSION LIIh'ES FOR COST PEfR STUD&NT 
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FIGURE 2. PLOT OF REGRESSION LIKpS FOR C05T PER STUDENT HOUR 
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In, summary , the cost analysis does not show a definite differen- 
tial between the two methods typically used in vbcatipnal programs — 
co-op. and non-co-op. 
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Based on the cost data collected, we used two cost measur^ for 
analysis .purposes--Annual Cost Pei: Student and Annu^l^^eost^,?er Student- 
Hqur. The Annual Cost Per Student measure shows a differential of about 
$190, favoring co-op programs. This differential is a marginal statis- 
tically significant difference. On the basis of cost per student hoyr, 
there is a differential of about $8, favoring nott^co-op programs. This 

difference is also marginally significant. There is wide yariation in 

^ \ • , • * ' 

both' measures across programs and across schools^ b^ut these variations 

V 

can be explained very well, as being a function of the st\ident-teacher 
ratio. That ^s, the co^t of a program i^not a function of the program, 
nor the method, but the efficiency with which human re'spurces (teachers) 
are used; ^ . • \ 

Tfius, Qur overall conclusion, based' on this initial study. Is 

* »♦ . • ' . - 

that t%ere is no obvious difference in the cost of providiiig either^ 



cooperative vocational education programs or those without a cdoper^tive 
component. ^ 
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EFFECTIVENESS ANALYSIS BASED ON 
. SCHOQL-'PROVIDED DATA ' 



- Ten effectiveness- measures were developed from information co! 
lected from the^sdlools. The purpose of the measures is »to serve as in- 
dicators^f differences among 'programs, and particularly between co^-op 
and non-eo-op programs on an aggregate basis. These treasures are the 



following: 



(1) Percentage o^ studenCs graduating 

(2) PercenJtage distriSlition of employment status* 

(3) Mean entry wage rate per hour 

(4) ^ Mean most recent wage rate per* hour ^ 

(5) Percentage distribution of location of initial 
employment 

(6) Percentage distribution of location of most recent 
employment . ^ * . * 

(7) Percentage of graduates admitted to formal 
apprenticeship progf^s 

enq>loyers 

(9) Mean length -of- longeqyt employment (months) 

' • ' ■" " ^ 

-(10) Mean number" of weeks after graduation until-^ 
obtaining full^trlme employment,-/ 
In calculating* the effectiveness-measure estimates, it should 
be remembered^ that the data base consists of a sairole of students from 
an individual program, and not necessarily the entire population of 



(8) 



?ercentage of graduates with two or less' 
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Students within the pr6gram* Where the nxanber of studertts in a progr^' ? ' 
was small, however *thfe respondent tended' to supply available data for 
all students. The net effect of this collection process *as that the data 



available for the effectiveness analysis t:btvstituted a re] 



4 

1 ^ej 



e^entative 



sampling of data on students within the programs and did ^6t constitute 
a survey of the complete student population in the- prograxtfe^^ ^ A tots^l 
of 1376 students formed the sample for which all or pajrt o^^the data 
were reported, ^ • v j'; 

The first measure, Percentage of Students Graduafcirig, is 
intended to 'provide a measure of the success of the individukl program 
types being studied. It was calculated as the ratio of the number of 
students graduated to th^ total number of students either graduated 
or not graduated* No inferenc^B were made concerning missing d<ata, 
and missing data were exclude'd froflrthe calculation. No data were 
available for 9 percent of the students on this measure. ''^ ^ 

The second jneasufe. Percentage Distributiotfcof Employment 

' ' ' " \ ' ' 

Status/; can be used to^ measure the effectiveness or ineffectiveness ^ 

of the various program types) The data were classified into one 'of 

five categories: , ^ - fS.^ 

(1) Pres^tly employed 



(2) Continued education after graduation 



(3) Entered military services 
^ (4) Unavailable for employment ^ 

^ ' (5) Presently employed. ' ' » , 

The graduates who continued their education after high school include^ 
tlibse enrolled in a, four year college, a full-time two yeai? community 



or junior college, a technical school or other post-secondary school. 
The graduates unavailable for employment include those with family 
responsibilities or other reasons for not being 'available. 

With the classification of the data into the five employment 
lE^catus categories, percentages were calculated for each category as the 
f^tio of the number of* graduates in the category to the total number for 
all five categories. Missing data were excluded and represent about 
17 percent of the data^. 

• ' . * i ' / 

The thind measure of effecti'^eness_^ Meaui^Entry Wage R^t'e ter 

Hpur was calculated as an arithmetic average for ea^i program, as' was ^ ^ 

the fourth measure. Mean Most Recent -Wage Rate Per Hout. The two. 

measures together represent an index of the progress of graduates from 

particular programs for comparison purposes, Data for a particular 

' program was reported according to one of three followup periods-- 

3 to 6 months, 7 to 12 months, or 13 to 18 month^/ Since most of the 

responses were based upon a \% tV 18 month -follow-up period, 'attention 

wa^ focused on this 3et of data^ and the few cases for the 'other < 

follow-up periods we re "excluded.. This -so' only^ ftfr t}ie Most Recent "* . 

.Wage Rate Per Hour Ind not"* for the.Etitry Wage Rate Pei; Hour. -Missing . v 

data for the Entry Wage Rate Per ilour amounted to about ^1 percent of the 

students,^ and for Host Recejit-'Wage Rate Per Ho^r about 76 percent. An 

additional 4 percent of data biased upon shorter, follt5w*up periods was . . 

.excluded also. *Jt should be remembered, however, that a substantial part 

«... * • ' • 

of these missing data is due to students not Veing available for employment, 
Nevarjtheless, this appears, to bfe, a difficult data item to collect. 



The" fifth and^sixth measures of effectiveness deal with the^ 
location of /initial* and laostf recent employment, 'respectively. These 
measures are intended to indicate in part the degree 'to which the voca- 
tional programs s^rve the employment needs of the coiffinunitie3. Per- 
centages were calculated as the ratip of the number of graduates in, one . 
of three categories to the total number of graduates for which data were 

available. The 'three categories are: ' » v * . 

• • • ' * * ' • 

- (1) Employed within the lo^al labor market » * 

(2) Employed outside the local labor marke^ . . 

but within the state . . ^ 

. (3) Employed outside the stat^, > , 

For initial^ emgloyment location, data were available on about 42 percent 
of the graduates and for most recent employment location, data were 
available for abput 39 percent .of the graduates. Of course, some of ^ - ' 
the "missing" data in fact are not missing but represent graduates who 
did not ent'er the labor market ^or some reason or were unemployed. 

The seventh measure. Percentage of Graduates Admitted to a 
Formal Apprenticeship Progj?:am, was calculated as the ratio o5 the number ' - 
6f positive respoirses to the total number of positive and negative responses 
Excluding missing' data, from the calculation resulted* iti data beir^g available 
for about 34 percent of the graduates. ^ ^ 

The eighth measure of effectiveness was the Percentage of 
Graduates with-Two^.or Less Employers Since Graduation. It was calculated 
as the.ra!:io of the number of graduates for whiqlji two or less ejnployers 
were i^orted, to the total number of graduates for whifch data V»ere 
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available, excluding missing data. Data were wailablfe for . approximately 

60 percent 6f the graduates. Missing data again includes graduates not 

available for employment. ^ * ' ' , - * ^ 

The ninth measure of effectiveness. Mean Length-'of Longest 

• » \ ' - ♦ / 

Bnployment was calculated as an arithmetic average, exclu<iing missing 
data. . Once again, since the majority of the (feta were reported for a 
'li. to 18 month follow-up period ^ only ^ata for this, period were included, 
to the exclusion of data for the other followwp ^periods, and missing 
^^taj» ^Xhe .estimates to be presented represent- about 2'9 percent of the 
graduates. Missing data here^also includes graduates not available for 
employment. ' • , -i 

" The tenth" and final measure. Mean Weeks After ^Graduation 
Until tuH Time EmplojrraeR^fi^ was calculated as an arithmetic average, 
excluding missing data, pata w^re ayailfable fpr approximately 40*/ 
percent of ^ the graduate?. The missing 4ata and' .graduates not available 
for employment represent the 60 percent of unavailable data. 

m 

* In all cases. where arithmetic averages were calculated, stan- 

/ 

dard deviations dlso calculated to^ provide ati indication df 

thd spread or variation in thfi data/ Standard statistical formulas 
were '^ployed for these calculations. Fpr random samples approxi- 
ipa'te'ly 40 or more observations, the arithmetic'" average plus or minus 
two tlmei the standard deviation, represeny approximately 95 percent 
confidence limits for a particular observation. 
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■.Refcts o'f the Effectiveness Analysis 



Based on ^chool-Provided Data . • 



Table Sjpjfesents a summary /of the results of "the effectiveness 
, ^ • analysis for ^a'bh.M ,the ten *ef fectiveness measures . for , the- study . These 
results, are «pres'eri;ted for twelve of the ftf)urte*en vocational program areas 



the ftf)i 
the two 



included^in the s|udy, for each ol the tiJo aggregate^ p;co|ram types (co-op 



and nbn-co-op) an4^ f dr all programs. Data were not reported, by. the 
school districts tor two of the non-co-op program areas^ Special Office' 
'Training, and Welding, and these two program areas consequently do not 
appear in the Table. Blank entries in the table indicate addjLtioDi^l 
cases where d^ta were not reported for a particular effectiveness 
measure*. Wherever it was felt that .the number of graduates upon t^ich 
a measure wad estiriiated would be informative ^ that information was 
- included in the Table. The interpretation. of these tesults is presented, 
in the following section. 



Interpretation of Effectiveness- Analysis 
Based on School-Provided Data ^ 

it \ - * ^ ■ . ' ' ^ 

tfable 5, the^Jj^ effe^iveness measure. Percentage of 

' j' 1 ' ^ * ♦ • * ' 

Students Qi^adbating, ranges from a low of 75 percent for 'the noh-co-op 



Auto Body Program to a high of 100 percent for several program areas. 

i \ \ ' 

The low was based upon/data for only 8 students which is too small^ a 

sanjple to indicate Significance. The average percentage for co-op 

programs doesl not* appear to be significantly different from that for 

non-.conop pro^grams, and it can be concluded tha't the methods do not- 

differ signif Icantiy 'if their effectiveness is. measured in this manner. 
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* When' considering the second effectiveness measure, Percentage 
Distril>ution of Employment Status, several of th6 classifications are 
,o£ particular interest. The. fi^rst of these is the percentage o^graduates 
currently employed* In Table 5, for co-op p^grams, 46^7 percent of the 
graduates are currently employed, and for non-co-op programs, 40.6 percent 
^re currently employed. If a ^f^tsttcBl test o^ significance (difference 
in' two^proportidns)^is conducted, a test stat^s'tic of 2.04 results, which 
is significant for. a test at the .05 significance level. Consequently 
for the program areas studied, the difference in percentage of graduates 
employed is significant 'in favor of graduates of co-op programs. However,, 
further examination of this measure is warranted. If the percentage of 
graduates unemployed is -.considered, the co,-op programs display a percentage 
"of 5,1, while the non-co-op {Programs show'a percentage of 3.1. 'Using the 
.same test, ^ a test statistic of 1.74 results which istnot significant at 
-the .05 significance leyel. Consequently, although a significantly 
greater percentage of graduates of co-op programs are currently employed, 
there i's no significant difference irf the rates of unempldyed graduates. 
This' suggests -that a greatet proportion of the graduates of non-cd-op 
programs are engaged in other activities which result In^tkeir being 
unavailable for employment. " These activities include continuing their 
education^ military service, family responsibilities, etc. ^ 

The third and fourth measures of effectiveness in Table 5 . 

together^ provide another means of comparing the two jaethods. Of iti- 

" , * ' * '* ' 

' terest here might be the increase in wage rate based tm the follow-up 

period of 13' to 18 months. Table 6 summarizes this ihfdrmatlpjx for" thfe^ 



TABLE 6. -COMPARISON OF WAGE RATES ^BASED ON' A'- 
FOLLOW-UP PERIOD .OF 13 to 18 MONTHS 



Program 



Average 
Most Recent 
Wage Rate^ 




Average 

Entry -Wage Iijc^ase in 
Rate 
'($/hr,) 



v*u ur ♦ 

• 


* 






s tfibut i_ve Education • 


$2.66 


$1.95 


$0.71 


V O J. ^ XCU Www ^ ^ V w 

Training, 


2.60 • 


2.17 


0.-43 . 

« - 


• 

Cooperative Office^, 

Education • 
• 


2.20 


- 1.69 


- 

0.51 


^rade'^^ijd Industry 


3.33, 


2.04 ' 


1.^9 / 


Cooperative Work 
Experience 


- 


t 




' All C0-9P Programs 


2. 54 


1.92 


'. 0.62 ^ 


N0N-€0-OP 


♦ 






Auto 'Mechanics 


$2.95 


$2.22 


$0.73 


Auto Body ^ 


3.. 02 . 


" - 2.07 * 


' 0.95 ; V 


Electricity/Electronics 


2.68. 


2.54 


(decrease) 


Drafting 


■ 2., 89 


. 2.24 


. 0.65 


Machine Trades 


3.19 


2.60 


0.59 


General Office 


•?.08r 


1,81 ■ 


0.27 


Steno 


.2.44 


2.00 


0.44 .. 


All Non-co-op. Programs 


2.73 • 


• ■ 2.28 


•■ 0.45 " 


: ■ ■ J 
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present study. The average wage r^te increase fbr graduates of co-op ^ 

./ ' . ' ' , - 

prograpis based on this follow-up period was $0r^2 per hour. For gra<^uates 

of non-co-op programs, the average wage' rate increase was $0.45 per hour. 

Howeve^, the graduates of co-op programs had an aveifage entry wage rate 

lower than those for non- cor op programs, so that eveYi with fhe larger ^ ^ 

injtrease, these same graduates had a lower average most recent wage rate. 

The most recent wage rates differ by $0.19, per hour. The^.Aspin-Welch 

m 

'test of significance^ conducted on these most recfent wage rates yields a 
test statistic of 2.23 which indicates that the graduates iOf the non-co-op 
programs have significantly higher wage rates on the average basedf on a 
13 to 18 month^ follow-up period. However, since missing data/amounted to 
approximately 61 percent for Entry Wage Rate, and almost aO 'p"c^n*^ for 
Most*Recen.t Wage Rate, the generality of this conclusion is questionable. 
It is important to consider the ooci^patlonal areas that aife included in 
non-co-op programs versus co-op programs. For example, the labor market 
conditions are certainly different for auto mechanics versus sales cletTcs. 

The fifth and sixth measures of effectiveness in Table 5 offer 
a comparison of vocational programs in terms of the degree to,whicli th^ 
programs serve the employment needs of the communities. There seems to 

'be little difference between co-op programs and non-co-op programs on 
these measures'. However, it i3 interesting to note the change for all 
programs after the folloW-up period. ' Initlaliy, 95 perceift of .the 
employed students in all ptograms obtained ^employment within the local 
•labor market, and at the time of the follow-up this percentage dropped 
to about 90 percent. A test of signif icance^on this difference yiel^is 
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level when the Aspin-Welch Test of Significance^is' applied to the dkta^, 

i 

'yielding a test statistic of 2.49. In realistic terms, a onermonth | 
differential may not be very meaningful. 11 
The final mea3ure of effectiveness in Tablets, Average weeks ^ 
After Graduation Until Obtaining Full-Time Employment, shows a difference 
of 1.5 weeks between co-op and non-ca-op programs^ This is significant 
at 'the .05 significance level ^en the Aspin-Welch Test of Signific^ance 
is applied, yielding a tesi: statistic of 2.10. There is quite a bit of 
variation for individual program areas in this measure. However, the 
d.ata appear to reflect th^ fact that co-op students tend^t0 find fixll- ^ 
time employment sooner than non-co-op students. This seems realistic 
in that -the graduates of ,co-op programs in some cases continue employinent 
with the same employer they had before graduation. Once agalnj* howevfer, 
this 1.5 week differential may riot mean much in a practical sense. 

In summary, the ten effecajS^eness measures estimated for the 

data collected under the present study indicate the following: 

' 0 There is 'no significant difference in percentage 
of students succ^sfully graduated from co-op and 
non-co-op progjJroJs. 
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There is n<f significant difference in the unemploy- 
ment rate.s of graduates of both types of programs, 
although' a-significantly higher percentage of the 
co-op gradiiates entered th^ Tabor market sooner. 

Graduates, of co-op programs entered the labor i 
market with* a lower entry wage rate which increased 
more rapidly than the wage rates of graduates- of 
nola-co-op programs; however, a^tet a 13 to 18 month • 
follow-xip /period, 'the graduates of non-co-op prp^rams 
still had a significantly higher wage rate. It is 
importatlt tro' remember- that the labor market conditions 
in non-g.o-op" occupational areas are different - tha^ 
.those fbr co-op. areas, e.g*, auto mechanics versus 
sales clerk. 



• Ther-e is no significant difference in the percentage. ' 
of graduates entering the local labor market as opposed 

to tlios^ entering other labor markets for the two 
types of programs; however, after a follow-up period, 
it appears that this percentage drops significantly , 
for bp th types of programs. ^ ' , 

• There is no significant difference beOween program 
I ^ types Qn the percentage of graduates admitted to 

formal apprenticeship programs* _ 

r • ' 

> There is no significant difference betweeti program 
types with respect ^to .emplSyment stability, measured 

.as the precentage of graduates with two or less 
employers during ^the follow-up period; the stability* • 
measure appears favorable for both type^s of programs, 

The graduate^ of non-co-pp programs have an average 
> length of longest- employment which is one month 

^greater than cor^dp program graduates for the,follow- 
'up period, and this -difference is statistically 
significant* Practically, however, this is not a \ 
great difference. ,^ , ' 

• Co-op graduates tend to find full-time employment 
an average- of 1.5 weeks sooner than .^n on- co-op 
graduates which- is a- statistically significant , 
difference*, but not a practical difference. 

These results are indicated by the pr^senV study but caution 

should be exercised In assximing that they hold in general. Since the 

sample of programs selected was not made in a, random manner, the ^ ^ 

gfeherality of the conclusions to cover all geographical regions, program 

areas,' etc., is questionable. Furthermore, it would be desirable to 

improve the data collection processes in order to reduce the amount of 

missing data encountered under the present study. 



31 



\ t 



ERIC 



Survey ot Employers 



' This^was a, minimal survey of employers in each community. Eacii* 

school district provided us with about 15 firms that had hired the majority 
of graduates of vocational programs. niailed 200 questionnaires an^i re- 
ceived completed questionnaires from 90 firms. This is a 45 percent res- 
ponse rate. * ' ^ . » 

The .size- of the firms based on the number of emplo/ees ranged 
between 3 and 5,000,- with a mean of 377. The distribution of fipns 
based on three size categories is as fallows: ^ 
Ntimber of Employees Numbar ot Firms 



33 
90 



Percentage 
40.0% ~ 
23.3% 
36.7% 
100.0% 



Less than 25 " ' 36 

• 25 to 100 21 
. Greater than 100 
Total 

Thus, there is a fairly good representation of firms based on the number 
of emploj&ces. ^ . . ' ^ 

Several points mu^t be kept in mind itl reviewing ther^ results 
of this - survey. 

1 

# The quest idnhaire is ^n attitudinal instrument that 
doeg npt require any analysis of data on the part 
^ ^ ^ . ^f '£he respondent. . ^ ' 

t.^ The school district personnel provided the names of . . 

theS' potential respondents. In 'every case Ue a^ked* 
. 5 for an^ifelrfased.list. * 



4 It. was essSatial that the firm. have knowledge and 
expetience^ith both co-op and nonrco-op vocational 
graduates. - In many' cases we suspect that this mea^it 
* ' t|iat the firms Had worked with co-op students while 
thejr were' in. school. Thus,:^heife is probably an 
inherent bias stemming from this. Of course, we 
have^no way of knowing whether the bias is positive 
•or ^^gativQ with regard to co-op students. . 
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# The sample (90 responses) is^small. / 

• ^. -She respondent may be expressing '.an attitude base4, •. , 

a small saidple of em|>loyees whc^ were graduates of 
either co-op or non-co-op vocational programs, \ 

The ''questionnaire is <Uvided into three^nnain parts: \. 

0 Hiring and training experiences ^\}'; 



•* E^^erience during the adjustment period of 
employment (first 6 months) 

f Job performance after the fir^t 6 months of 

employment • ' ■ - 

Table 7 shows the questionnaire items for each of .the three 



Figures 3 through 6 are sunsaaries of#the restiits of the survey 




33 




w 

o 



e 



• § 



E 

3 



5 
w 

o 
o 

w 
9 



<9 

3 

U 

c 
o 
u 



I" 



3 
o 

w 

o 

c 

o 

* <3 

s. 

O 
> 
C3 



as m 

I. C3 w OS 



(5 -5 



a 



r4 



o ^ o 
so so 



O 



a : 

& J 

2 o 
> S 
2 3 

g ^ 

CO 



0 



(Favoring 
co-op) 



(Favoring 
noa-co-op) 



^ 3 
(No DiffO 
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(Missing) 



g (64) 4,2 pet. 




I ' (9) 0,6 pet., ' 



■i 



-J 1- 



(897)* 58.6 pcfc. 



(560) 36.6 pet. 



•J 



. i 



• 1 



J 1: 1 1 — ^ 



J I 



O 20 30 40 50' 60 70 , 80 90 100 



V , Percent Responses 
' — 

* Indicates the number of responses. . , 



FIGURE 3. RESULTS OF EMPLOYER SISRVE^y-AhL^ 
. QUESTIONNAIRE items' • ' ' 
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FIGURE 4. RESULTS OF EMPLOYER SURVEY, QUESTIONNAIRE 
ITEMS DM HIRING AND TRAINING EXPERIENCES, 
ITEMSn THROUGH 4 ... 
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•PIGURE 5. RESULTS OF EMPLCJYER SURVEY, QUESTIONNAIRE 
ITEMS, ON EXPERIENCE DURING THE"* ADJUSTMENT 
' ^ ■ PERIOD, ITEMS 5 THROUGH 13 
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' FIGURE 6. RESULTS OF EMPLOYER SURVEY, QUESTIONNAIRE 
ITEMS ON JOB ♦PERFORMANCE AFT^R THE FIRST 
./ 6'm6nTHS of EMPLOYMENT, ITEMS 14 THROUGH 
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Interpretation of Results of 
Employer Survey 



/f These results shoW a very- definite favorable attitude on 

the parj' of employers toward the gradua«tes. of co-op vocational programs. 

FigurefS shows that the percentage of responses favoring co-ojJ graduates 

ii 58i^> percent versus 4.2 percent for non-co-op graduates, with 36.6 

percent indicating no significant ilifference. The .results^^axe very 

simmar for the three main parts of the survey —.Figures 4 through 6,, 

^^sT The results for each questionnaire item show that the co-op 

. if 

^4duates are favored for all items. ^ 

Admittedly, there §re several as^pects of this survey that 
^n be questioned. We cannot use these re^^s in an absolute sense 
^o Conclude that co-op vocational programs are better than non-co-op 

I ■• , . . ■ • 

^programs; however, there is no question thai: the lilajority of the 
ninety employers that res-ponded definitely have a favorable attitude 
toward the ^r^duatea of co-op programs. 

We are very pleased with 'this instrument. .Evidently it is 
cl'early presented and people can, complete it fairly easily. It. would 
be i^ery ^asy -to tise this instrument on a. large, random sample of firms 
throughout the country in order . to obtain a preliminary view o^) the 
attitudes of employers toward employees who are graduates of co-op 
vocational programs versus thoae who are graduates of non-co-op 
vocational programs. . • - 



, : ■ I'INDINGS AND COfNCLUSIONS . 



This analysis was a preliminary attempt to inv^stigartfe differences 
in cost, and effectiveness of co-op vocational programs versus non-co-op 
programs. The maiji finding is that there does not. appear to be'' a clear- 
cut difference betweetf the cost of providing vocation^** programs based * 
upon the co-op method and the cpst of providirig those tased upon the 
noh-co-op method. It is premature to conclude that this is generally the 
case since the data used here were not bas'ed on random sampling nor were 
they representative' of all .programs conducted in the United States today. 

There may very well^be other cases in other schciol districts that would 

. V - ' . • ' : 

show a* cl^ar-cut difference. 4 * ' ^ 

* ' The ifl^e significant finding in the cost analysis is the strong • . 
relationship exhibited between.* the student-teacher fatio and either %. 
the Cost Per Student or the Cost Per Student-Hour measures. Everi though 
the.dlmiple was not large and som^^^ments of cost w^re eatimate<£ (equip- 
replacement cost), the stud^^beacher ratio serves- vei^jW&l^^^ 



explain the variation, in the two cost measures. ' ^ - ^.^^ 
It is a fact that tTie greatest cost element In the educatiorfSl' 
system is the dixect instructional expense. Jt is only logical that 
the cost is a function, of the student-vteacher ratio.;; That, the • ^ 
moat effective way. to control costs is to control th^ stu^^-teache\ 
ratio.. Obviously from ah efficiency point of View, i^t .is less cd^tly. 
to have a ratio of 30 to 1 than a ratio of 15 tq, 1. "It must fee r*emem- - 
^ered pf^ cojj^se that the effectiveness of the educational process may 
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change' significantly with this ratio, and this should Be considered 
in any to taL analysis ♦ 

The effectiveness- comparisons are based mosbly on standard 
foUow-up ,infonnation provided hy the schools on. graduates of the vo- 
cational programs. In addi-tion, a brief survey of employers was con- 
ducted to obtain some attitudes from employers regarding graduates of 
co-op versus non-co-op programs. 

On the" basis of school-provided'^ information, we note differences 
between co-bp and-noxj-co-op program graduates as follows: 

• 'Graduates of co-05, programs enter the labqr 

' market \^±th a lower entry wage rate that increases 

mpre rapidly, but graduates of non-co-op programs 
^ill earn a higher rate ffter aCfollow-up period 
of 13 to 18 months; It must be remembered that " 
this is probably due moi^e to the' occupational 
area itself and .^;he labor market conditions than 
to the educational experiences ♦ 

• The. graduates of non-corop programs remain with their 
longest full- time employer slightly longer (one 

• month) than <Jp the graduates of co-op programs; based 
'upon a 13 to 18 month follow-up period. This 

difference is significant in a statistical sense, 
but^not in a practical sense. 

>~* ' ■ ■ • ■ . . 

• . Graduates of co-op programs tend to find full-t^e 

enq)loyment slightly faster than -their non-qo-op 
V. counterpar,ts, but the difference is ^ly 1.-5 weeks— 
not a very practical difference. 

There-^^s no significant difference bet^/een' the. graduates of 

co*op programs versus non-co-op programs on the basis of the, followfng 

measures: • # 

Those students who successfully graduate 

• Unemployment rates ■ ' . * ' " . 
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Those entiering the local labof market. versus 

those leaving the local community . . • 

V Those graduates who .entered- formal apprenticeship 
programs 

\ 

^ # Employment stability as measured by th^ number of 
different: employers after graduation. 

Our overall, conclusion basecL on the follow-up measures provided 
by the schools is that there is no- x>bvious^ difference (in a practical 
sense) betwefen graduates of co-op vocational programs and graduates of 
non-co-op programs. The effect of the occupation itself and the labor 
market conditions are probably more important than the vocational school- 
ing, or the method used in providing vocational training. 

The employer survey very definitely showed a difference. The 
sample of employers favored graduates af co-op programs (58.6 pe*rcent) 
oyer those of non-co-op programs (4,2 percent), with 36.6 percent indi- 
cating no difference, and 0.6 percent missing data. We must recognize 
that this sample was small (90 out of 200 employers returned the 
questionnaire) and that there were some inherent biases that we were 
unable to control, due to the choice of employers who received the question 
naire. The school districts provideir the lists of employers and individiml 
to whom we sent th^ questionnaire. We do not' think that there was any . 
deliberate attempt to bias the results, but we could riot design the survey^ 
to uncover any bias, due to the. limited scope of this part of the study. 
Nevertheless, it is important to note that a majority, of the sampled 
employers definitely favor graduates of co-op programs. 
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^' Our overall conclusions based on tjhe employer survey are 
that employers tend* to favor graduates of co-op t>rograms and that the 
process of measuring effectiveness through a questioning of Employers 
restiilts in a much more clear-cut differential between the two methods 
than does the follow-up information normally collected by school 
systems. ' > n 
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